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FOREWORD 


This  report  was  prepared  by  the  Presentation  of  Information 
Section,  Human  Engineering  Branch,  Behavioral  Sciences  Labora¬ 
tory,  6S70th  Aerospace  Medical  Research  Laboratories,  under 
Project  No.  7183,  "Psychological  Research  on  Human  J^rform- 
ance,  ”  Task  No.  718303,  "Research  on  Human  Intellectual  Func¬ 
tions.  "  It  is  the  second  of  two  reports  dealing  with  human  problem¬ 
solving  behavior.  The  first,  WADD  TR  60-2,  "£i>me  Aspects  of 
Problem  Solving:  L  Method  and  Materials,  "  describes  many  of 
the  characteristics  of  the  material  used  in  this  study.  The  authors 
are  grateful  to  Richard  Buchanan  and  John  Christian,  who  collected 
many  of  the  data,  and  to  R.  H.  Hoerner,  Data  Processing  Branch, 
Data  Services  Division,  and  E.  L.  Godfrey,  Analysis  Branch, 
Digital  Computation  Division,  Wright- Patterson  Air  Force  Base, 
Ohio,  for  their  valuable  services  in  effecting  computer  analyses 
of  the  data.  The  experimental  work  was  performed  at  the 
Engineering  Psychology  Research  Project  at  Antioch  College, 

Yellow  Springs,  Ohio,  during  1959  and  1960  under  Contract 
AF  33(616)-6095. 
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ABSTRACT 


Performance  on  a  forced-choice  target  detection  task  was  examined 
in  terms  at  the  sequences  of  responses  subjects  made.  In  about  50 
percent  of  all  cases  resulting  in  a  correct  detection,  subjects  made  a 
specific  error  immediately  before  identifying  the  correct  target.  In 
about  the  same  percentage  of  cases,  but  of  failure  to  detect  the  correct 
target,  that  same  error  was  given  instead  of  the  correct  response. 
Practice  on  the  task  resulted  in  a  general  improvement  in  speed  and 
number  of  correct  detections,  and  also  in  a  change  in  the  proportional 
occurrence  of  certain  errors:  the  most  likely  but  wrong  response  (X) 
was  given  more  often,  and  the  least  likely  and  wrong  response  (Z)  was 
given  less  often,  with  practice,  b  addition,  while  the  best  25  percent 
of  the  subjects  detected  more  targets  to  criterion  and  detected  them  more 
rapidly  than  the  poorest  25  percent,  the  proportional  occurrence  of 
specific  response  patterns  was  approximately  the  same  in  the  two  groups 
for  the  targets  that  were  correctly  detected.  Scaled  similarity  of  the 
alternatives  was  an  important  determiner  of  errors,  while  perceived 
orientation  had  no  relation  either  to  perceived  similarity  or  to  the 
response  sequences.  A  mechanism  is  suggested  for  these  sequential 
acts  involving  a  decrease  in  probability  of  detecting  specific  kinds  of 
forms  following  perception  of  another  kind. 


PUBLICATION  REVIEW 


Ibis  technical  documentarv  report  has  been  reviewed  and  is 
approved. 


WALTER  F.  GRETHER 
Technical  Director 
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SOME  ASPECTS  OF  PROBLEM  SOLVING: 

SEQUENTIAL  ANALYSIS  OF  THE  DETECTION  OF  EMBEDDED  PATTERNS 


INTRfH>UCTK»( 


Certain  kinds  of  problems  can  be  solved  by  successfully  applying  certain  rules.  Sometimes 
a  set  of  rules  Is  defined  eiqpllcltly  to  a  subjects  and  the  taM^  then  consists  In  choosing  the  primer 
ones  to  get  from  a  set  of  givens  to  the  goal  (ref.  11).  Sometimes  the  subject's  task  Itself  consists 
In  detecting  or  defining  the  rules  of  operation  (ref.  10).  hi  either  case  there  Is  a  certain  formal¬ 
ism  about  the  problem  and  about  the  solving  process,  and  when  subjects’  responses  are  parti¬ 
tioned,  It  may  be  found  that  certain  transformations  or  certain  strategies  are  preferred  over 
others  (ref.  13).  Reflecting  the  "structure"  of  the  problem,  responses  often  converge  at  various 
stages  of  the  solving  process,  and  successful  solutlcm  of  the  problem  may  occur  only  If  certain 
steps  are  taken  In  a  certain  sequence.  In  some  cases.  In  firnt,  it  becomes  possible  to  speak  of  a 
form  of  "threshold"  for  solving  the  problem,  since  the  profaaUlity  of  ultimately  detecting  ttie 
correct  solution  increases  with  the  number  of  correct  steps  taken  toward  It,  even  though  the  steps 
do  not  necessarily  make  eqval  contributions  to  the  solving  process  (ref.  1).  The  solving  process 
in  these  cases  may  be  sho^  to  have  a  specific  shape  or  developmental  sequence. 

Ihe  question  arises  whether  such  phenomena  of  "cognitive"  proUem  solving  can  be  found  in 
the  simpler  cases  of  target  detection  and  "perceptual"  problem  solvii«.  Do  nifajects'  responses 
show  some  patterning,  is  there  some  evolutionary  development  or  sequence  of  steps  throng 
which  subjects  must  go  In  order  to  detect  a  target  correctly?  Does  the  mechanism  invtdved  in 
visual  search  have  some  preferred  mode  of  operation  with  respect  to  various  forms,  which  Is 
revealed  by  specific  response  nttems?  Miller  and  Frick  (ref.  10)  have  described  a  mettiod  for 
looking  at  sequences  (rf  respooMs.  This  paper  describes  the  application  of  qualitative  aspects 
of  this  method  to  the  case  of  detecting  targets  embedded  In  vlsaal  noise. 
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METHOD 


Stimulus  Materials 


The  stimulus  materials  were  100  cards  on  each  of  which  two  rows  of  geometric  figures 
appeared.  The  bottom  row  contained  four  numbered  figures,  usually  pentagons.  Only  one  of 
the  numbered  figures  appeared  in  all  of  three  complex  figures  contained  in  the  upper  row.  Four 
typical  cards  are  shown  in  figure  1.  The  method  for  constructing  these  stimulus  figures  and 
some  of  their  characteristics  have  been  described  elsewhere  (ref.  8) . 


C> 


12  3  4 

Ko.  I> 


0  CiO 

12  3  4 

Mo.  M 


JU-  ^ 

12  3  4 

No.  47 


No.  100 


Figure  i.  Four  of  the  100  Test  Carde 

On  each  card  one  numbered  figure 
in  the  lower  row  appeared  in  all 
three  figures  of  the  upper  row. 

The  code  numbers  (12,  IS.  47.  100) 
did  not  appear  on  the  face  of  the 
cards. 


Each  stimulus  card  was  displayed  once  every  4  seconds  for  0. 5  second  by  means  of  ai^ra* 
tus  previously  described  (ref.  9).  Ibe  stimulus  cards  were  at  an  optical  distance  of  100  centi¬ 
meters  and  the  display  on  each  occupied  an  area  of  10  by  10  centimeters  (S.  7*  square) .  Lumi¬ 
nance  of  a  display  card  was  2  footlamberts.  Observation  was  dioptlc  with  light -adapted  eyes. 
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Subjects 

Subjects  were  24  male  and  24  female  undergraduates,  paid  volunteers.  Each  subject  was 
assigned  haphazardly  to  one  testing  sequence,  and  was  tested  individually  three  times . 


Procedure 


The  100  cards  were  divided  into  three  decks  of  33,33,  and  34  cards,  with  one  deck  pre¬ 
sented  at  each  testing  session.  Two  male  and  two  female  subjects  were  shown  the  cards  in  each 
of  the  six  possible  permutations  of  decks,  in  one  order  of  presentation  of  the  cards.  Another 
group  (two  male  and  two  female  subjects)  was  presented  the  cards  in  the  reverse  order  of  each 
of  the  permutations.  The  effects  of  fatigue  and  practice  were  approximately  balanced  in  this  way. 

The  subject's  task  was  to  identify  by  number  the  one  figure  in  the  bottom  row  of  each  card 
that  appeared  in  all  three  figures  of  the  upper  row.  The  basic  e^qperiment  consisted  of  25  conse¬ 
cutive  0.  S-second  presentations  of  a  card  at  the  rate  of  one  presentation  every  4  seconds.  After 
each  presentation  the  subject  was  required  to  .call  out  his  best  guess  of  the  right  answer.  Before 
beginning  to  answer  to  a  card,  however,  the  subject  was  shown  the  upper  row  of  figures  only, 
for  three  0.  S-second  "pre-exposures. "  In  a  typical  e]q>erimental  session,  a  subject  was  shown 
33  cards,  to  each  of  which  he  gave  25  consecutive  reports.  A  2-minute  rest  intervened  between 
the  fifteenth  and  sixteenth  cards  dividing  the  session  into  two  parts.  Thus,  there  were  six  testing 
periods,  three  sessions  with  two  periods  to  each  session.  In  each  period  the  subject  responded 
to  about  16  cards,  each  of  which  was  presented  approximately  25  times.  A  period  lasted  about 
30  minutes. 

As  there  were  four  possible  answers  to  each  card,  the  chance  probability  of  giving  the 
right  answer  on  any  trial  was  0. 25.  To  insure  that  the  subject  had  detected  a  target  with  more 
than  chance  success,  the  criterion  was  adopted  that  he  must  have  given  at  least  ten  consecutive 
correct  responses  after  the  fifteenth  trial.  Ten  consecutive  correct  responses  given  early  in 
the  sequence,  but  followed  by  incorrect  responses,  was  considered  a  failure.  However,  if  the 
subject  had  begun  a  series  of  consecutive  correct  responses  after  the  sixteenth  trial,  presenta¬ 
tions  were  continued  beyond  the  twenty-fifth  trial  until  the  subject  had  given  ten  consecutive 
correct  responses,  or  one  wrong  response. 


Methods  of  Analysis 

The  results  of  two  different  analyses  are  presented.  One,  for  cards  solved  to  the  criterion 
of  ten  consecutive  correct  responses  after  the  fifteenth  trial,  is  the  proportion  of  correct  detec¬ 
tions  on  any  trial,  p(r(.),  taken  across  subjects  and  across  cards.  'The  other  is  the  sequence  of 
runs  of  responses  made  while  trying  to  detect  the  target.  The  latter  is  more  complicated  and 
requires  illustration. 

The  25  responses  made  by  two  subjects  to  a  sample  card,  the  correct  answer  to  which  was 
4,  were  as  follows; 

Subject  A;  11  444  33333  22  111  4444444444 

Subject  B;  33  111  3  44444  2  1  333333  22  1111 

The  two  sequences  have  been  broken  into  runs,  six  runs  for  subject  A,  nine  for  subject  B.  For 
subject  A,  the  content  of  the  ultimate  wrong  run  was  1,  of  the  penultimate,  2,  and  of  the  ante¬ 
penultimate,  3.  Subject  B,  while  not  solving  the  problem,  also  had  the  same  answers  as  the 
contents  of  his  last  three  runs . 
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The  number  of  female  subjects  making  each  possible  response  on  the  last  three  wrong  runs 
was  tabulated  for  each  card.  Let  X*  stand  for  the  most  frequently  occurring  wrong  response  on 
any  card  made  by  the  female  subjects  on  the  ultimate  wrong  run,  Y'  for  the  next  most  frequently 
occurring  wrong  answer,  and  Z'  for  the  alternative  that  occurs  least.  Such  determinations  of 
X',  Y',  and  Z',  based  principally  on  the  contents  of  the  ultimate  wrong  runs  made  by  the  female 
subjects  to  each  problem,  were  used  to  evaluate  the  runs  made  by  the  male  subjects.  *  Thus, 
the  sequence  of  Z'Y'X’A  indicates  that,  on  a  given  problem,  the  subject  gave  as  his  first  run  of 
wrong  responses  an  alternative  chosen  the  fewest  number  of  times  in  place  of  the  correct  one, 
improved  this  on  his  next  run,  then  chose  the  alternative  given  most  often  in  place  of  the  right 
answer,  and  finally  gave  the  right  answer  itself.  Taken  across  all  problems,  the  symbols  will 
be  used  without  primes. 


RESULTS 


The  24  male  subjects,  presented  with  100  cards  each,  generated  a  total  of  2400  cases 
(approximately  60,000  trials).  Of  these  2400  cases,  1812  were  correctly  detected  to  criterion 
and  564  were  not.  Errors  in  collecting  the  data  were  detected  in  the  remaining  24  cases,  which 
have  been  excluded  from  the  analysis. 

Of  the  1812  successful  cases,  there  were  511  in  which  the  male  subjects  gave  only  correct 
responses  to  a  card;  such  correct  responses  were  symbolized  as  A.  In  addition,  there  were 
500  cases  in  which  the  male  subjects  gave  exactly  one  wrong  run  prior  to  the  criterial  run,  295 
cases  in  which  they  gave  exactly  two  wrong  runs,  and  506  cases  in  which  they  gave  at  least  three 
wrong  runs.  These  various  forms  of  successful  performance  are  segregated  in  column  7  of  table 
I,  and  the  proportions  shown  in  that  column  are  to  the  base  1812. 

In  this  experiment,  there  are  3"  possible  ways  for  the  subject  to  give  n  wrong  runs  when 
successive  identical  responses  are  regarded  as  part  of  one  run.  Column  1  of  table  I  shows  the 
27  possible  ways  to  give  three  wrong  nins,  each  pattern  terminating  in  the  correct  response,  A, 
and  column  2  shows  the  frequency  and  proportion  of  occurrence  of  each  pattern  among  the  1812 
cases.  In  column  3,  these  four-letter  patterns  are  collapsed  to  their  common  three  letters, 
yielding  ninepatterns(see  ref.  12).  In  addition,  in  the  upper  part  of  the  table,  these  nine  patterns 
are  repeated  and  the  number  of  cases  are  shown  of  only  three -letter  patterns  (i.e. ,  two  wrong 
runs  and  the  criterial  run).  In  column  5,  both  of  these  sets  are  collapsed  to  the  three  patterns 
which  show  their  common  two  letters,  and  the  cases  of  only  one  wrong  run  prior  to  the  criterial 
run  also  are  shown.  Column  7,  as  noted,  shows  the  total  number  of  cases.  The  first  entry  in 
column  7,  A  511,  indicates  the  number  of  cases  in  which  the  correct  answer  only  was  given.  ♦* 
The  proportions  in  columns  2,  4,  and  6  are  based  on  the  subtotals  shown  in  column  7 . . 
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also  were  added.  Independent  aroups  of  subjects  were  used 

group  to  define  X.  t.  and  Z,  and  another  group  on  which  these  definitions  were  used 
quantitative  differences  between  Bales  and  fenales  (see  Results)  but.  In  tact.  If 

used  both  to  define  and  to  test  X,  T.  and  Z, .  ^io^fJr^as  the 

ent  froa  what  they  are,  so  that  tfce  qualitative  differences  between  Bales  and  fesales.  so  far  as  tne 

ordering  of  the  responses  goes,  are  snail. 

••One  tactic  used  by  sone  subjects  «s  that  of  calling  out  a  *t?;l®  the*ca8es'^ln**whlch 

searching  for  the  correct  target.  The  entry  of  Ml  In  the  A-only  cell  Includea  the  cases  in  wnicn 

subjects,  using  this  tactic,  by  chance  picked  the  c®ir®®t  JJ®*®?  ?R.*5S,£i'5i,‘li5iiures  ** 
those  In  which  the  target  wad  detected  eorreetly  on  the  basis  of  the  three  pre-expoaures. 
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Columns  5  and  6  of  table  I  show  that  the  most  frequently  occurring  two-letter  pattern  is  XAt 
and  p(XA)j  its  proportional  occurrence,  is  nearly  the  same  (.51,  .51,  and  .47),  whether  genera¬ 
ted  in  two-,  three-,  or  four-run  sequences.  Without  regard  to  the  number  of  wrong  runs  pre¬ 
viously  generated,  subjects  converge,  in  about  50  percent  of  the  cases,  on  a  specific  error  imme¬ 
diately  before  identifying  the  correct  target.  (This  error,  of  course,  varies  from  problem  to 
problem.)  In  similar  fashion,  p(YA)  is  .27,  .28,  and  .28  in  the  three  sequences,  respectively. 
Other  comparisons  of  identical  patterns  also  show  considerable  agreement,  those  patterns  includ¬ 
ing  X's  generally  occurring  more  frequently  than  those  without  X's.  All  of  these  proportions  are 
based  upon  the  independent  frequencies  shown  in  column  7 . 

The  relations  described  so  &ir  have  been  for  the  targets  detected  to  criterion  only.  A  com¬ 
parison  of  these  successful  detections  with  failures  can  be  made  after  examining  columns  8  through 
14  of  table  I.  Column  14  shows  that  there  were  62  cases  of  failure  to  detect  the  correct  target  in 
which  the  subjects  made  only  one  run  (that  is,  gave  the  same  response  to  all  presentations),  83 
cases  in  which  two  runs  were  made,  and  419  cases  in  which  three  or  more  wrong  runs  were  made. 
Columns  12  and  13  show  that,  of  the  62  cases  of  one  wrong  run,  38  had  X  as  that  run;  similarly, 
of  the  83  cases  of  two  wrong  runs,  24  had  AX,  and  so  on.  Comparisons  made  across  the  two  parts 
of  the  table  show  fair  agreement  in  the  proportional  occurrence  of  similar  patterns.  It  appears, 
therefore,  that  neither  the  number  of  runs  made  nor  the  eventual  outcome  seriously  affects  the 
proportional  occurrence  of  the  various  patterns  shown  in  columns  5  and  12. 

Although  many  of  the  proportions  in  the  body  of  table  I  are  significantly  different  from  the 
expected  values  (pg)  shown  at  the  bottom  of  that  table,  there  is  little  predictive  value  in  the 
early  wrong  runs.  A  negative  correlation  (r  «  -.45,  p<  .05)  between  number  of  runs  and  number 
of  targets  detected  to  criterion  and  a  positive  correlation  (r  *  .80,  p  <. 01)  between  numbers  of 
runs  on  failed  and  on  solved  cards  suggest  why:  subjects  tend  to  be  consistent  in  the  number  of 
runs  made  to  problems,  and  primarUy  the  poorer  subjects  (those  detecting  fewer  targets)  make 
the  greater  number  of  runs.  Failure  also  is  characterized  by  more  variability  than  is  success. 
Comparing  columns  7  and  14  shows  that  only  28  percent  of  the  targets  correctly  detected,  but  74 
percent  of  the  failed  ones,  had  three  or  more  wrong  runs. 

Several  subsidiary  analyses  of  the  data  were  undertaken  to  explore  the  reliability  and 
identify  the  determinants  of  the  patterns  shown  in  table  I. 

a.  A  comparison  was  made  of  the  best  and  poorest  25  percent  of  the  subjects.  Figure 
2  shows  how  the  extreme  quartiles  differ  on  successive  trials.  Two  curves  are  plotted  for  each 
group  showing  the  absolute  proportion  of  correct  detections  for  all  targets  (triangles)  and  the 
proportion  of  correct  detections  for  the  targets  detected  to  criterion  (circles) .  Both  level  of 
performance  and  rate  of  improvement  with  trials  clearly  are  greater  for  the  best  subjects.  How¬ 
ever,  table  n, which  is  similar  in  principle  to  the  left  of  table  I,  indicates  that  these  differences  in 
speed  and  power  do  not  affect  the  sequences  of  responses.  (The  four -letter  patterns  have  been 
collapsed  to  their  common  three  letters  because  of  the  small  frequencies.)  While  columns  5  and 
5'  show  tlHit  the  best  subjects  tended  to  detect  targets  with  fewer  runs  than  did  the  poorer  subjects, 
columns  1  through  4  and  1’  through  4'  show  that,  for  a  given  number  of  runs,  the  proportional 
occurrence  of  specific  patterns  is  approximately  the  same  in  the  two  groups  of  subjects.  Columns 
4  and  4'  may  be  compared  with  each  other  as  well  as  with  column  6  of  table  I.  Such  comparisons 
ngnin  fibow  a  tendency  toward  equality  in  the  proportional  occurrences  of  similar  patterns. 
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b.  Since  the  data  were  collected  over  six  testing  periods,  they  were  analyzed  for  the 
effects  of  practice.  One  of  these  effects  ai^ars  as  an  increase  in  the  occurrence  of  correct 
detections  with  succeeding  trials.  In  figure  3  the  proportional  occurrence  of  correct  responses 
for  targets  detected  to  criterion,  p(rc),  is  plotted  on  the  ordinate  for  the  first,  fifth,  and  each 
additional  fifth  trial,  while  testing  periods  are  plotted  on  the  abscissa.  This  quasi-inductive 
visual  discrimination  task  yields  data  similar  to  those  found  with  "learning  sets"  (ref.  7),  and  in 
other  studies  of  target  detection  (refs.  2  and  6).  Yet  another  effect  of  practice  is  the  change,  in 
successive  testing  periods,  in  the  values  of  XA  and  ZA  shown  in  figure  4.  A  general  increase 
appears  for  p(XA)  and  a  general  decrease  for  p(ZA),  the  averages  of  the  two-,  three-,  and  four- 
letter  patterns.  Thus,  with  practice,  subjects  both  improve  their  ability  to  detect  the  correct  tar¬ 
get,  as  shown  in  figure  3,  and  converge  on  the  choice  of  error  made  prior  to  a  correct  detection, 
as  shown  in  figure  4.  The  long  "rise  times"  for  these  results,  extending  over  2500  trials  per 
subjects,  are  notable.  The  sex  differences  shown  in  figure  3  describe  an  initially  higher  level 
of  performance  by  the  males,  but  a  higher  rate  of  improvement  by  the  females. 


figure  3.  Effects  of  Practice  on 
Correct  Detections 

The  ordinates  show  the  proport  ions 
of  correct  detections  for  targets 
detected  to  criterion^  Successive 
testing  periods  are  plotted  on  the 
abscissa.  The  parameter  is  the  trial 
number.  The  figure  shows  that  per- 
formance  on  all  trials  improves  with 
successive  testing  periods.  Note  the 
difference  in  slope  of  the  curves  for 
the  males  and  females.  The  curves 
may  be  read  vertically  within  periocfs 
to  show  relations  similar  to  those  of 
figure  2. 


Figure  4.  Effects  of  Practice  on 
Choice  of  Ultimate 
Wrong  Run 

A.  The  proportional  occurrence  of 
X  as  the  ultimate  wrong  run,  p(XA), 
is  shown  on  the  ordinate  for  the 
successive  testing  periods  shown  on 
the  abscissa. 

B.  The  proportional  occurrence  of 
Z  at  the  ultimate  wrong  run,  p(ZA), 
is  shown  on  the  ordinate  for  the 
successive  testing  periods  shown  on 
the  abscissa. 
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c.  The  influence  of  perceived  similarity  between  alternatives  on  the  choice  of  responses 
was  evaluated  in  a  manner  analogous  to  the  presentation  shown  in  table  1.  For  that  evaluation,  36 
male  subjects  judged  the  similarity  of  the  four  alternatives  to  each  other  for  30  cards  selected  at 
random.  These  results  were  used  to  evaluate  the  response  sequences  on  those  same  problems 
for  the  24  male  subjects  in  the  main  e]q>eriment. 

To  obtain  the  similarity  definitions,  three  forms  at  a  time  from  each  card  were  arranged 
as  a  triad  and  photographed  on  strip  film.  Each  of  the  four  figures  on  a  card  was  the  standard  for 
one  triad,  with  position  of  the  alternatives  counterbalanced  among  subjects.  The  subjects  indicated, 
for  each  triad,  which  of  the  two  alternatives  was  more  similar  to  the  standard.  Each  subject  made 
384  judgments  of  which  the  first  24  were  practice.  "Similarity"  itself  was  not  defined  to  the  sub¬ 
ject.  Scaled  distances  of  the  three  alternatives  on  each  card  from  the  correct  target.  A,  were 
computed  (ref.  18,  p.  263  ff.).  The  most  similar  alternatives  (closest  to  A)  were  defined  as  X', 
the  next  most  similar  as  Y',  and  the  least  similar  as  Z'. 

A  sequence  analysis,  analogous  to  tables  I  and  n,  was  made  for  the  24  male  subjects  for 
the  30  cards  whose  alternatives  had  been  judged  for  similarity.  A  comparison  of  the  proportions 
obtained  by  this  "similarity  definition"  of  X,  Y,  and  Z  with  those  obtained  by  the  "frequency  defini¬ 
tion"  used  i  n  tables  I  and  11  is  shown  in  table  m.  The  agreement  on  X  between  frequency  and  simi¬ 
larity  determinations  was  high(  ^  -  73  percent),  while  a  symmetrical  inversion  occurred  for  Y 
and  Z.  While  overall  similarity  of  the  alternatives  to  the  target  accounts  for  a  large  portion  of 
the  coding,  other  factors  also  are  important. 


TABLE  m 

CONCORDANCE  OF  CODES  BASED  ON  FREQUENCY  AND  ON  SIMILARITY 


Frequency 

Definition 


Similarity  Definition 


X 

Y 

Z 

n 

X 

22 

6 

2 

30 

Y 

6 

6 

18 

30 

Z 

2 

18 

10 

30 

n 

30 

30 

30 

X®- 

p  < 

c  44.8, 

.01 

B: 

II 

d.  Similarities  of  orientation  of  the  response  alternatives  might  be  thought  to  be  an 
important  influence  in  confusing  them.  The  role  of  orientation  was  investigated  in  turn,  both  as 
a  predictor  of  response  sequences  and  as  a  predictor  of  judged  similarity.  No  relation  of  orienta¬ 
tion  was  found  to  either  variable.  The  test  was  made  as  follows. 

The  response  alternatives  from  the  30  cards  used  for  the  judgments  of  similarity  des¬ 
cribed  above,  plus  two  other  cards,  were  photographed  one  at  a  time  on  strip  film.  Four  male 
subjects, tested  individually,  judged  the  same  set  of  figures  once  each  day  on  four  successive  days. 
The  order  of  presentation  of  the  figures  was  different  on  each  day.  The  film  strip  was  projected 
onto  a  white  wall,  one  frame  at  a  time  at  a  distance  which  made  the  figures  occupy  from  10  to  25 
centimeters  squared.  Presentation  of  the  figures  was  automatic  and  occurred  once  each  10  seconds 
for  7  seconds.  Immediately  to  the  right  of  the  projected  figures  was  a  pointer  8  centimeters  long 
controlled  by  a  Selsyn  motor.  On  the  appearance  of  a  figure,  the  subject  rotated  a  knurled  knob 
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at  hla  desk  until  the  wall  pointer  indicated  the  apparent  orientation  of  the  figure.  The  subject's 
setting  was  recorded  by  the  experimenter  and  the  pointer  reset  to  due  north  before  presentation 
of  the  next  figure. 

The  objective  orientation  of  each  figure  was  defined  as  the  slope  of  the  line  that  mini¬ 
mized  the  squares  of  the  perpendiculars  from  the  points  of  the  figure  to  the  line.*  The  correla¬ 
tion  coefficients  between  orientation  so  calculated  and  the  subjects'  mean  settings,  or  perceived 
orientation,  varied  from  r  =  .  70  to  r  =  .84  for  the  four  subjects  individually,  and  was  .  83  for  the 
subjects  as  a  group  (for  all  of  these  values,  r  <  .01).  See  figure  5.  Thus,  orientation  calculated 
as  above  is  a  good  predictor  of  perceived  orientation. 


figure  5.  Ptrceivtd  Ver$ut  Calculated  Orientation 

The  plotted  value*  of  perceived  orientation 
repre*ent  the  mean  of  all  (etting*  made  by 
the  4  subject*  for  a  given  figure. 


•Tha  line  has  the  property  of  being  invariant  with  rotation  of  the  figure.  The  elope  of  the  line  in 
Civeii  tie  equAtlon 


•here  <f!  in  the  variance  of  the  polate  projected  onto  an  x-aila.  Or  the  variance  on  the  5r*Jl5>,55^ 
Otviu  the  covariance.  The  calculated  alopen  were  converted  to  angular  valuen  between  0*  and  180*. 
In  obtaining  anbjacta’  naan  aettlnga,  a  value  of  ISO*  waa  aoaetlnea  added  to  none  aetttnM.  Tbje 
•aa  doae  waan  the  raaponaen  by  a  aingla  anbjact  to  the  aane  figure  wer^  for  exaaple, 

WO*,  and  iV.  Thun"  aoBi  of  the  plotted  polnta  in.  figure  5  axceed  180*.  ,IhlB  rule  of  "add  180*" 
waa  Invekad  only  when  a  difference  of  nora  than  iltT  aeparated  the  original  valuea. 


10 


AMRL-TDR-62-148 


To  determine  whether  perceived  orientation  was  a  dimension  of  perceived  similarity^ 
and  whether  it  was  a  significant  contributor  to  the  response  patterns  shown  in  table  n,  the  abso¬ 
lute  differences  in  calculated  orientation  between  a  target  figure  and  its  three  alternatives  were 
found.  These  alternatives  were  labeled  X',  or  Z'  in  order  of  increasing  difference  from  A. 

The  30  problems  coded  by  similarity  were  recoded  for  orientation.  A  count  of  the  concordance 
in  choices  between  frequency  and  orientation^  analogous  to  that  of  table  m,  indicated  that  orienta¬ 
tion  of  the  alternatives  had  no  predictive  value  in  identifying  response  confusions.  A  similar 
count  of  concordances  in  coding  alternatives  based  on  orientation  versus  similarity  showed  simi¬ 
lar  results.  While  calculated  orientation  of  a  plane  figure  is  a  good  predictor  of  perceived  orienta- 
tionj  there  appears  to  be  no  significant  relation  between  orientation  and  perceived  similarity. 


DISCUSSION 


The  principal  purpose  ot  this  experiment  was  to  discover  whether  a  behavioral  sequence  of 
a  kind  analogous  to  that  found  with  certain  cognitive  problems  also  characterized  perceptual  prob¬ 
lem  solving.  Stated  otherwise,  the  question  was  whether  the  perceptual  mechanism  goes  through 
some  strategy  in  detecting  targets,  and  whether,  if  such  formal  sequences  occur,  it  is  possible 
to  define  the  characteristics  of  the  stimuli  which  provoke  them. 

With  respect  to  the  first  question,  the  answei  is  an  equivocal  yes:  in  about  SO  percent  of  all 
cases  with  at  least  one  error,  the  subjects  made  a  specific  error  before  detecting  a  target  correct¬ 
ly.  In  addition,  in  about  SO  percent  of  the  cases  of  failure  to  detect  the  correct  target,  that  same 
error  was  given  in  place  of  the  correct  response  (table  I).  Further,  comparison  of  good  and  poor 
subjects  indicates  that,  while  the  better  subjects  are  characterized  by  greater  speed  and  more 
power  on  the  task,  the  two  groups  make  a  given  error  just  before  a  correct  detection  about  the 
same  proportion  of  times:  that  is,  p(XA)  for  the  best  and  the  worst  subjects  has  about  the  same 
value  (table  II) .  Finally,  the  effects  of  practice  were  shown  to  be  twofold:  more  targets  were 
correctly  detected  more  rapidly  with  practice  and  certain  errors  came  to  be  preferred  to  others. 

With  respect  to  the  second  question,  the  characteristics  of  the  stimuli  which  provoke  these 
patterns,  the  judgments  of  similarity  indicated  that  perceived  similarity  is  a  fair  predictor  of 
errors:  alternatives  most  similar  to  the  target  are  mistaken  for  it  most  often.  One  would  expect 
no  less.  However,  no  relation  was  found  between  similarity  and  orientation.  In  view  of  subjects' 
sensitivity  to  orientation  (ref.  4)  this  might  be  considered  surprising,  although  orientation  as  a 
variable  has  been  shown  to  have  little  effect  on  discrimination  and  transfer  among  adult  higher 
animals  (refs.  5,17). 

How  do  subjects  detect  a  target?  Figure  2  indicates  that  induction  and  hypothesis  formation 
play  some  part.  The  figure  indicates  that  the  three  "pre-e;q>osures"  yielded  enough  information 
for  the  better  subjects  to  make  p(r(.)  on  the  first  test  trial  »  .39.  One  subject,  in  fact,  who  even¬ 
tually  detected  98  of  the  100  targets  to  criterion,  gave  the  correct  responses  to  52  of  those  98  on 
all  25  test  trials.  Taking  advantage  of  the  three  pre-e;q>osures  to  select  elements  out  of  the  upper 
row  to  match  them  against  the  lower  would  give  better  than  chance  responding  on  the  early  trials. 
This  seems  to  be  what  the  better  subjects  did.  Contrariwise,  waiting  for  the  answer  figures  and 
matching  them  against  the  upper  row  would  yield  only  chance  responding  on  the  early  trials.  This 
seems  to  be  what  the  poorer  subjects  did.  %e  figure  3.  Osier  and  Trautman  (ref.  13)  recently 
described  another  case  of  problem  solving  in  which  poorer  performances  were  more  stimulus- 
centered  and  better  performances  more  conceptual.  The  large  difference  between  the  two  curves 
shown  for  the  poorer  subjects  in  figure  2,  as  compared  with  the  small  difference  for  the  better 
subjects,  indicates  that  the  poorer  subjects  can  detect  the  correct  target,  but  are  poorer  because 
they  apparently  fail  to  recognize  that  they  have  detected  it. 
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In  the  main  task  described  here,  the  sul^ects  were  required  to  operate  on  a  complex  visual 
display  presented  to  them  for  0.  S-second  e^qMSures.  This  required  them  to  move  their  eyes  a 
good  de^  over  the  visual  field.  Such  forms  of  scanning  eye  movements  have  been  suggested  as  a 
kind  of  basis  for  all  form  perception  (seCi  for  example^  ref  5) .  But  the  present  results  occur  in 
a  situation  in  which  scanning  eye  movements  (contour-tracing),  even  if  the  subjects  had  time 
enough  to  scan,  would  produce  failure  rather  than  success,  since  the  figures  of  the  upper  row  are 
filled  with  visual  noise.  In  addition,  other  evidence  has  shown  that  whole  figures  can  be  seen 
without  eye  movements,  ambiguous  perspective  figures  continue  to  reverse  in  stopped  image 
conditions,  and  parts  of  a  contour  deteriorate  while  other  parts  remain  (refs.  14,  15).  The 
scanning  provides  the  logistic  support  for  perception,  getting  eyes  to  where  they  need  to  go, 
while  the  perceiving  is  affected  by  other  means.  Finally,  in  answer  to  the  question  of  how  a  tar¬ 
get  is  detected,  the  occurrence  of  the  patterned  responses  raises  the  possibility  that  some  form 
of  carom  or  rebound  effect  dominates  the  matching  of  parts  that  seems  to  occur.  In  the  pro¬ 
cessing  of  serially  presented  information,  the  probability  of  perceiving  a  given  kind  of  form  may 
not  remain  constant,  but  may  vary  as  a  function  of  the  ktod  of  form  already  perceived,  revealing 
a  kind  of  perceptual  refractory  period  or  figural  masking.  We  are  currently  attempting  to  investi¬ 
gate  this  question  e;q)erimentally. 
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